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(54) Tracking area determination apparatus and object tracking apparatus utilizing the same 



(57) An object tracking apparatus includes a motion 
vector detection circuit in which a correlation value for 
each of detection blocks are evaluated by a first correla- 
tor on the basis of a portion motion vector of each of the 
detection blocks and a reference vector. If the correla- 
tion value is smaller than a threshold value, the detec- 
tion block corresponding to the correlation value is 
regarded as a detection block constituting a tracking 



area. A gravity of the tracking area is detected by a grav- 
ity detection circuit, and a motion vector is generated by 
a motion vector generator on the basis of the gravity. A 
universal head is driven in accordance with the motion 
vector, whereby a specific object can be tracked auto- 
matically. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the invention 

The present invention relates to a tracking area 
determination apparatus and an object tracking appara- 
tus utilizing the tracking area determination apparatus. 
More specifically, the present invention relates to a 
tracking area determination apparatus and an object 
tracking apparatus utilizing the tracking area determina- 
tion apparatus which utilizes a representative point 
matching method. 

Description of the prior art 

Two examples of conventional such a kind of object 
tracking apparatus are disclosed, for example in Japa- 
nese Patent Application Laying-Open No. 2-117276 
laid-open on May 1 , 1990. One is an apparatus in which 
an optical flow as shown in Figure 16(b) and a histo- 
gram of the optical flow as shown in Figure 16(c) are 
detected on the basis of an object image as shown in 
Figure 16(a), and then, an object tracking area as 
shown in Figure 16(d) is determined. In the other, a per- 
son B existing at a center of the image shown in Figure 
16(d) is set as a specific object, and then, an object 
tracking area as shown in Figure 17(c) is determined on 
the basis of an optical flow as shown in Figure 1 7(a) and 
a histogram as shown in Figure 1 7(b). 

However, in the former, since it is impossible to dis- 
tinguish the specific object from other objects, it is diffi- 
cult to track the specific object if the other objects move. 
On the other hand, in the later, although it is possible to 
track the specific object, it is necessary to manually set 
the specific object, and therefore, an operation 
becomes troublesome. 

SUMMARY OF THE INVENTION 

Therefore, a principal object of the present inven- 
tion is to provide a tracking area determination appara- 
tus capable of determining an object a tracking area 
automatically 

Another object of the present invention is to provide 
an object tracking apparatus capable of tracking only a 
specific object. 

According to the present invention tracking area 
determination apparatus which determines an object 
tracking area within a screen comprises: a first correla- 
tion means which evaluates a portion motion vector for 
each of a plurality of detection blocks defined within the 
screen on the basis of a minimum correlation value 
between representative point data in a last fiejd and 
pixel data in a present field; a second correlation means 
which evaluates a correlation value between the portion 
motion vector and a reference vector for each of the plu- 
rality of detection blocks; arxi a determination means 



which determines detection blocks by which an object 
■ tracking area is to be defined on the basis of compari- 
son of the correlation value and a predetermined 
threshold value. 

5 In accordance with the present invention, the por- 

tion motion vectors of the plurality of detection blocks 
formed within the screen are evaluated by the first cor- 
relation means on the basis of the minimum correlation 
values between the representative point data in the last 

w field and the pixel data in the present field. Then, the 
correlation values between respective portion motion 
vectors and the reference vector are evaluated by the 
second correlation means. Furthermore, the detection 
blocks which constitute the object tracking area are 

15 determined by comparing the correlation values and the 
predetermined threshold value by the determination 
means. 

In an aspect of the present invention, the reference 
vector of the next field is evaluated on the basis of the 

20 portion motion vectors in the tracking area of the 
present field. 

In another aspect of the present invention, an oper- 
ation mode is set into a first mode by a first mode setting 
means. Then, the first correlation means evaluates the 

25 portion motion vectors in all the detection blocks formed 
in the screen. 

In a further aspect of the present invention, the 
operation mode is set into a second mode by a second 
mode setting means. Then, the first correlation means 

30 evaluates the portion motion vectors of the detection 
blocks constituting the tracking area of the last field and 
detection blocks adjacent to the tracking area at an out- 
side of the tracking area. 

In accordance with the present invention, since the 

35 detection blocks constituting the tracking area are deter- 
mined by comparing the correlation value evaluated by 
the second correlation means and the predetermined 
threshold value with each other, it is possible to set the 
tracking area automatically 

40 According to a second invention, an object tracking 
apparatus comprises; a first correlation means which 
evaluates a portion motion vector for each of a plurality 
of detection blocks defined within a screen on the basis 
of a minimum correlation value between representative 

45 point data in a last field and pixel data in a present field 
. of the plurality of detection blocks; a second correlation 
means which evaluates a correlation value between the 
portion motion vector and a reference vector for each of 
the plurality of detection blocks; a determination means 

50 which determines detection blocks by which an object 
tracking area is to be defined on the basis of the com- 
parison of the correlation value and a predetermined 
threshold value; a gravity detection means which 
detects a position of a gravity of the tracking area; a 

55 motion vector generating means which generates a 
motion vector on the basis of the position of the gravity 
and a position of a center of the screen; and a tracking 
means which tracks the object according to the motion 
vector. 
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In the present invention, the gravity of the tracking 
area is detected by the gravity detection means, and the 
motion vector generating means generates the motion 
vector on the basis of the positions of the gravity and the 
center of the screen. Then, tracking means tracks the 5 
object according to the motion vector. 

In accordance with the present invention, since the 
object is tracked according to the motion vector gener- 
ated on the basis of the positions of the gravity of the 
tracking area and the center of the screen, it is possible 10 
to track only a specific object included in the tracking 
area. 

The above described objects and other objects, 
features, aspects and advantages of the present inven- 
tion will become more apparent from the following 15 
detailed description of the present invention when taken 
in conjunction with the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 
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Figure 1 is a block diagram showing an embodi- 
ment according to the present invention; 
Figure 2 is a block diagram showing one example of 
a motion vector detection circuit of the embodiment; 
Figure 3 is an illustrative view showing an operation 25 
for detecting a motion vector according to a repre- 
sentative point matching method; 
Figure 4 is an illustrative view showing one example 
of an arrangement of detection blocks; 
Figure 5 and Figure 6 are illustrative views showing 30 
the detection blocks, horizontal signals and vertical 
signals; 

Figure 7 is an illustrative view showing a tracking 

area set on the basis of portion motion vectors; 

Figure 8 is an illustrative view showing one example 35 

of the tracking area as detected; 

Figure 9 - Figure 14 are flowcharts showing an 

operation of the embodiment: 

Figure 15 is an illustrative view showing the tracking 

area set on the basis of the portion motion vectors; 40 

Figure 16 is an illustrative view showing a prior art 

of a case where a camera is locked; and 

Figure 17 is an illustrative view showing a prior art 

in a case where a camera is manually moved to 

track an object. 45 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

An object tracking apparatus 1 0 of this embodiment 50 
as shown in Figure 1 includes a camera 12 which takes 
an object and outputs an image signal. The image sig- 
nal is inputted into a motion vector detecting circuit 1 4 
which sets a tracking area on the basis of the image sig- 
nal and detects a motion vector on the basis of a gravity 55 
of the tracking area. The motion vector is applied to an 
universal head control circuit 16 which outputs a drive 
signal, on the basis of the motion vector for a drive unit 
18. The drive unit 18 drives an universal head 20 on the 



basis of the drive signal. Therefore, the camera 12 is 
driven to a horizontal direction and/or a vertical direction 
so as to control an attitude of the camera in a manner 
that the gravity of the tracking area moves to a center of 
a screen, whereby an object can be tracked automati- 
cally. 

The motion vector detection circuit 14 constructed 
as shown in Figure 2 includes a tracking area determi- 
nation circuit 22. The tracking area determination circuit 
22 includes an A/D converter 24 which converts the 
image signal into digital data for each pixel. The digital 
data is data obtained by digitally converting Y, R-Y. B-Y 
signals, for example. 

The image signal is also applied to an H-SYNC 
separation circuit 28 and a horizontal address counter 
30 both included in a timing generator 26. The horizon- 
tal address counter 30 counts the number of the pixels 
in the horizontal direction according to the image signal, 
and resets a count value thereof at every one line in 
response to a horizontal synchronization signal from the 
H-SYNC separation circuit 28. The count value of the 
horizontal address counter 30 is applied to a horizontal 
decoder 32 which decodes the count value and outputs 
horizontal signals HO to H2. HO' to H2. and HO". 

The image signal is also applied to a V-SYNC sep- 
aration circuit 34 and a vertical address counter 36. In 
the vertical address counter 36. the number of the pixels . 
in the vertical direction is counted in accordance with 
the image signal, and the vertical address counter 36 is 
reset at every one field in response to a vertical syn- 
chronization signal from the V-SYNC separation circuit 
34. A count value of the vertical address counter 36 is 
applied to a vertical decoder 38 which decodes the 
count value and outputs vertical signals VO', VI' and . ^ 
VO". 

Also with referring to Figure 4 and 5, a screen 40 in 
which a motion vector detection area 42 is defined is 
formed in a view finder 12a of the camera 12, and the 
portion motion vector detection area 42 is divided into 
detection blocks of 375 ( = m x n = 25 x 15 ), for exam- 
ple. Furthermore, a specific detection block 44a is put 
in. for example, a center of the motion vector detection 
area 42. In addition, as shown in Figure 3, each of the 
detection blocks 44 includes X pixels in the horizontal 
direction and Y pixels in the vertical direction, and a 
center of the detection block becomes a representative 
point. 

Furthermore, the tracking area determination circuit 
22 includes a CPU 46 to which a tracking mode switch 
48 for starting a tracking mode is connected. When the 
tracking mode switch 48 is turned-on in a state where a 
position of the camera 12 is controlled such that a spe- 
cific object is positioned within the specific detection 
block 44a. a tracking start signal is applied from the 
CPU 46 to AND gates 50, 52 and 54. But. in a field that 
the tracking mode switch 48 is turned-on, that is, in a 
first field, the tracking start signal is applied to only the 
AND gate 50. 
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The CPU 46 is also connected with a mode chang- 
ing switch 56 which changes the tracking mode 
between a first mode and a second mode. In the first 
mode, the tracking area is determined with using all the 
detection blocks 44 in the motion vector detection area 
42! In the second mode, the tracking area is determined 
with using detection blocks 44 are determined in the last 
field to constitute the tracking area (the specific detec- 
tion block 44a in the first field) and detection blocks 44 
adjacent to the tracking area at an outside of the area. A 
mode signal for setting the first mode or the second 
mode is applied to a timing generator 26. 

In the first mode, the timing generator 26 outputs 
the horizontal signals HO to H2 and HO' to H2* and the 
vertical signals VO. V1. VO' and V V as shown in Figure 
5. In addition, waveforms of such signals don't change 
at every field. On the other hand, in the second mode, 
the timing generator 26 outputs the horizontal signals 
HO to H2 and HO' to H2' and the vertical signals VO. V1 , 
VO* and VV as shown in Figure 6 in the first field, and 
renews the horizontal signals HO' and the vertical signal 
VO' in accordance with a setting signal from a correlator 
70 in the second field, and renews the horizontal signals 
HO' to H2' and the vertical signals VO' and Win accord- 
ance with a setting signal from a tracking area determi- 
nation circuit 78 in and after a third field. 

The CPU 46 is also connected with a ROM 58 in 
which a program for controlling the tracking area deter- 
mination circuit 22 is stored and a ROM 60 in which data 
and etc. obtained as a result of an operation are stored. 

The digital data of the video signal outputted from 
the A/D converter 24 is latched by latch circuits 62 and 
64 in response to an enable signal from the AND gate 
50. and an enable signal from the AND gate 52. respec- 
tively. The representative point data of the detection 
.blocks 44 are latched by the latch circuit 62, and all the 
pixel data in the detection blocks 44 are latched by the 
latch circuit 64. The representative point data latched by 
the latch circuit 62 are written in a representative point 
memory 66 to be read-out in the next field. Then, the 
representative point data are latched by a latch circuit 
68 in response to an enable signal from the AND gate 
54. Pixel data of the present field outputted from the 
latch circuit 64 and the representative point data of the 
last field outputted from the latch circuit 68 are applied 
to the correlator 70. The correlator 70 evaluates mini- 
mum correlation values performing correlation calcula- 
tions between both data of the detection blocks 44. and 
evaluates portion motion vectors during a period of one 
field of the detection blocks 44 on the basis of the mini- 
mum correlation values. In addition, in the second field, 
the correlator evaluates only one portion motion vector 
because only representative point data and pixel data of 
the specific detection block 44a are applied to the corre- 
lator 70. 

The portion motion vector evaluated in the second 
field is applied to a reference vector generator 74 
through a selector 72. and the portion motion vectors 



evaluated in and after the third field are applied to a cor- 
relator 76 through the selector 72. 

In and after the third field, the correlator 70 evalu- 
ates the portion motion vectors of all the detection 
5 blocks 44 in the first mode, and evaluates the portion 
motion vectors of detection blocks 44 determined in the 
last field to constitute the tracking area and detection 
blocks 44 adjacent to the tracking area at the outside 
thereof in the second mode. Furthermore, the correlator 
10 76 evaluates correlation values between respective one 
of the portion motion vectors from selector 72 and a ref- 
erence vector from the reference vector generator 74 so 
as to apply the correlation values to the tracking area 
determination circuit 78 
15 In the tracking area determination circuit 78, 
respective one of the correlation values are compared 
with a predetermined threshold value. The threshold 
value is set in accordance with a required detection 
accuracy. That is, when a high detection accuracy is 
20 required, the correlation value is set low. and if the high 
detection accuracy is not required, the correlation value 
is set high. Only the detection blocks 44 having the cor- 
relation values smaller than the predetermined thresh- 
old value are determined to constitute the tracking area. 
25 As a result, an area A, for example, as shown in Figure 
7(b) and Figure 7(c). Figure 15(a) to Figure 15(c) is 
determined as the tracking area. 

Specifically, in the first mode, the tracking area is 
determined with using all the detection blocks .44. On 
30 the other hand, in the second mode, the setting signal in 
accordance with a result of determination for the track- 
ing area is applied to the timing generator 26 at every 
one field, and therefore, the horizontal decoder 32 and 
the vertical decoder 38 renew the horizontal signals HO' 
35 to H2' and the vertical signals VO' and VI ' such that the 
tracking area is changed at every one field. In addition, 
in only the second field, the correlator 70 outputs the 
setting signal so as to renew the horizontal signal HO' 
and the vertical signal VO'. 
40 The portion motion vectors of the detection blocks 
44 which are determined by the tracking area determi- 
nation circuit 78 to constitute the tracking area are 
applied to an accumulator 80. Then, an x component 
and a y component of each of the portion motion vec- 
45 tors are accumulated by the accumulator 80, and aver- 
age values of the x components and the y components 
are applied to the reference vector generator 74 at 
every one field. Accordingly, the reference vector is 
renewed at every one field. 
50 Furthermore, an xy coordinates value of the detec- 
tion blocks 44 constituting the tracking area is applied to 
a gravity detection circuit 82 which detects a gravity of 
the tracking area and applies the gravity data. i.e... posi- 
tion data of the gravity to a motion vector generator 84. 
55 The motion vector generator 84 generates a motion 
vector on the basis of position data of a center of the 
screen 40 and the gravity position data so as to apply to 
the universal head control circuit 16. 
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Next, with referring to Figure 9 to Figure 1 4, a major 
portion of an operation of the object tracking apparatus 
10 of this embodiment shown will be described. 

When the video signal is inputted to the A/D con- 
verter 24 in a step Si shown in Figure 9. it is determined 5 
whether the operation mode is the first mode or the sec- 
ond mode in a step S3. If the first mode, steps S5 to S71 
are executed to detect the motion vector with using all 
the detection block 44. In addition, in this case, there is 
a possibility that two tracking areas having the same io 
motion vector are set as shown in Figure 8. 

In the step S5, it is determined whether or not the 
present field is the first field, and if "YES", it is deter- 
mined whether or not the vertical signal VO and the hor- 
izontal signal HO corresponding to the present pixel are is 
high level in each of the steps S7 and S10. At this time, 
if even one of the signals is the low level, the process 
proceeds to steps for the next pixel, if both signals are 
the high levels, the enable signal is applied to the latch 
circuit 62 from the AND gate 50. Therefore, the repre- 20 
sentative point data in the specific detection block 44a is 
latched by the latch circuit 62 in the step S1 1. and the 
representative point data is stored in the representative 
point memory 66 in the step S13. and thereafter, the 
process proceeds to steps for the next pixel. In the first 25 
field, the steps 81 to S13 is repeatedly executed. 

If "NO" in the step S5. it is determined whether or 
not the present field is the second field in the step Si 5. 
At this time, if "YES", it is determined whether or not the 
vertical signal VO' and the horizontal signal HO' are the 30 
high levels in each of the steps S17 and Si 9. If "NO" in 
even one of the steps, the process proceeds to the step 
S25 directly, and if "YES" in the both steps, the enable 
signal from the AND gate 50 is applied to the latch cir- 
cuit 62. Then, the representative point data of all the 35 
detection blocks 44 are latched in the step S21 . and the 
representative point data is stored in the representative 
point memory 66 in the step S23, and thereafter, the- 
process proceeds to the step S25. As a result, in the 
second field, the representative point data of all the 40 
detection blocks 44 are stored in the representative 
point memory 66 through the steps SI 7 to S23. 

If it is determined that the vertical signal VI is the 
high level in the step S25, and if it is determined that the 
horizontal signal HI is the high level in the step S27, the 45 
enable signal from the AND gate 52 is applied to the 
latch circuit 64. Accordingly, in the second field, the pixel 
data of X X y in the specific detection block 44a are 
latched in the step S29. 

Furthermore, if it is determined that the vertical sig- so 
nal VI is the high level in the step S25, and if it is deter- 
mined that the horizontal signal H2 is the high level in 
the step S31, the enable signal is applied to the latch 
circuit 68 from the AND gale 54. Accordingly, in the sec- 
ond field, the* representative point data of the first field ss 
read out from the representative point memory 66 is 
latched by the latch circuit 68 in the step S33. 

In addition, if "NO" in the step S27, the process pro- 
ceeds to the step S31 directly, and if "NO" in the step 
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S25 or S31. the process proceeds to the step S35 
directly. 

It is determined whether or not the process for the 
last pixel of the motion vector detection area 42 is com- 
pleted In the step S35. If "NO", the process proceeds to 
steps for the next pixel directly, and if "YES", the corre- 
lator 70 calculates the minimum correlation value 
between the pixel data from the latch circuit 64 and the 
representative point data from the latch circuit 68, and 
evaluates the portion motion vector on the basis of the 
minimum correlation value in the step S3 7. 

More specifically, in assuming that the representa- 
tive point data of the detection block 44jj in the last field 
is Rjjoo- ^"cl each of the pixel data of the detection block 
44jj in the present field is Sy^y. the correlation value Dly 
of the both data is calculated according to the following 
equation (1), and the minimum correlation value is eval- 
uated within a plurality of the correlation values. 

D1ii = |RijOO-Sjjxyl (1) 

i: number of the detection blocks in the horizontal 
direction . 

j: number of the detection blocks in the vertical 
direction • 

Then, the portion motion vector of the detection 
block 44jj during one field is evaluated on the basis of 
the xy coordinates value corresponding to the minimum 
correlation value. 

Accordingly, in the second field, the representative 
point data of all the detection blocks 44 in this field are 
written in the representative point memory 66, and a 
portion motion vector as shown in, for example. Figure 
7(a) is evaluated on the basis of all the pixel data 
included in the specific detection block 44a of this field 
and the representative point data included in the detec- 
tion block 44a of the first field. In the step S39, the por- 
tion motion vector is inputted and stored into the 
reference vector generator 74 through the selector 72 
as the reference vector for the next field. 

If "NO" in the step Si 5, it is determined that the 
present field is after the third field, and then, the process 
proceeds to the step S41 . If it is determined that the ver- 
tical signal VO' is the high level in the step S41 . and if it 
is determined that the horizontal signal HO' is the high 
level in the step S43, the enable signal from the AND 
gate 50 is applied to the latch circuit 62. Accordingly, the 
representative point data is latched by the latch circuit 
62 in the step S45, and the representative point data is 
memorized into the representative point memory 66 in 
the step S47, and the process proceeds to the step S49. 
As a result, the representative point data of the detec- 
tion blocks 44 of m X n are memorized into the- repre- 
sentative point memory 66 in this field through the 
execution of the steps S41 to S47. In addition, if "NO" in 
the step S41 or S43. the process proceeds to the step 
S49. 
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It is determined whether or not the vertical signal 
vr is the high lev/el in the step S49. and it is determined 
whether or not the vertical signal HV is the high level m 
the step S51 . Then, if "YES" in the both steps, the ena- 
ble signal from the AND gate 52 is applied to the latch 
circuit 64, and therefore, respective pixel data included 
in the detection blocks 44 are latched by the latch circuit 
64 in the step S53. More specifically, by the processes 
of the steps S49 to S53, the pixel data of the detection 
blocks 44 of m X n are latched in this field. 

Furthermore, it is determined that the vertical signal 
VV is the high level in the step S49. and if it is deter- 
mined that the horizontal signal H2' is the high level in 
the step S55, the enable signal from the AND gate 54 is 
applied to the latch circuit 58. and therefore, the repre- 
sentative point data of the detection blocks 44 of m x n 
in the last field are latched by the latch circuit 68 in the 
step S57. 

Thereafter, it is determined whether or not the proc- 
ess for the last pixel of the motion vector detection area 
42 is finished in the step S59. If "NO", the process pro- 
ceeds to steps for the next pixel. If "YES", the process 
proceeds to the step S61 . In the step S61 . the pixel data 
of the present field from the latch circuit 64 and the rep- 
resentative point data of the last field from the latch cir- 
cuit 68 are inputted into the correlator 70, and therefore^ 
the correlation values DIqo to Dl^^ are calculated, and 
the portion motion vectors of m x n are evaluated on the 
basis of the minimum correlation values of the detection 

blocks 44. ^ ^. 

Accordingly, in the third field, the representative 
point data of all the detection blocks 44 of this field are 
stored in the steps S41 to S47, and the portion motion 
vectors are evaluated on the basis of the minimum cor- 
relation values between the pixel data of this field and 
the representative point data of the second field in the 
steps S49 to S61. In addition, the representative point 
data in the second field are obtained by the processes 
of the steps S17 to 823. After a forth field, all the repre: 
sentative point data of the present field are stored in the 
steps S41 to S47. and the portion motion vectors are 
evaluated on the basis of the minimum correlation val- 
ues between the pixel data of the present filed latched in 
the steps S49 to S53 and the representative point data 
of the last field stored in the steps S41 to S47. 

Then, in the step S63. the m x n portion motion vec- 
tors are inputted into the correlator 76 through the 
selector 72. and therefore, a correlation calculation 
between each of the portion motion vectors and the ref- 
erence vector is performed. 

More specifically, on the assumption that an x com- 
ponent and a y component of the reference vector are 
x,„ and y,o. and each of an x component and a y compo- 
nent of the portion motion vector of the detection block 
44ij are x^, and yij,i. the correlation value 02,, can be 
evaluated by the following equation (2). 

D2ij = |x,o-Xjj,il + |y,o-yijtil (2) 



The correlation value D2ij is inputted into the 
tracking area determination circuit 78, and then, it is 
determined whether or not the correlation value D2i| is 
smaller than the predetermined threshold value in the 
step S65. if "YES", it is determined that the tracking 
area is the area A as shown in, for example. Figures 
5(b) and 5(c) in the step S67. 

The xy coordinates values of the detection blocks 
44 constituting the tracking area are inputted into the 
1 0 gravity detection circuit 82, and therefore, the gravity of 
the tracking area is evaluated. In addition, if two tracking 
areas are determined as shown in Figure 8, the gravity 
becomes a center of the tracking areas. The gravity 
data is inputted into the motion vector generator 84, and 
,5 a difference between the position data of the gravity and 
the center of the screen is outputted from the motion 
vector generator 84 as a motion vector for controlling 
the universal head 20. 

Further more, in the step S69. the portion motion 
20 vectors of the detection blocks 44 constituting the track- 
ing area are inputted into the accumulator 80. and the x 
component Xi.„ and the y component yii.i of each of the 
portion motion vectors are accumulated by the following 
equation (3) to obtain accumulation values x',o and y ,o. 



25 
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x;, =£x,,,/N (3) 



'i 

number of the detection blocks used in calcula- 
tion 



After that, the accumulation values x',o and y'^ are 
renewed as the x component x,o and the y component 
40 y,o of the reference vector in the step S71 Therefore, it 
is possible to make the reference vector correspond to a 
movement amount and a change of a direction of the 
object, and rotation of the camera 1 2 in automatic track- 
ing, etc. . . . . 
45 As described above, two tracking areas might be 
evaluated as shown in ,for example. Figure 8 in the first 
mode and in this case, the gravity takes its place 
between the two tracking areas. To settle this problem, 
the tracking mode is set into the second mode. 
50 Returning back to the step S3, if it is determined 
that the tracking mode is the second mode in the step 
S3 the operation is performed according to flowcharts 
as shown in Figure 12 to Figure 14. Such flowcharts are 
the same as the flowcharts as shown in Figure 9 to Fig- 
55 ure 1 1 except the renewal of the vertical signal VO' and 
the horizontal signal HO' in a step 108 and the vertical 
signal VC and VV and the horizontal signal H2' in a step 
SI 36 however, since the operation after the third field in 
the second mode becomes to be diHerent from the 
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operation in the first mode by addition of the steps Si 08 
and SI 36, the operation after the third field will be 
described mainly. 

In the third field, the vertical signal VO' and the hor- 
izontal signal HO' become the high levels according to . s 
the representative point data of the detection blocks of 
25 in total (5 in the horizontal direction and 5 in the ver- 
tical direction), the specific detection block 44a being 
arranged at the center of the blocks. Because the verti- 
cal signal VO' and the horizontal signal HO' are renewed io 
in the step SI 08. Accordingly, representative point data 
of 25 is stored into the representative point memory 66 
in the step S115. Furthermore, the pixel data of the 
detection blocks 44 of 9 in total (3 x 3). the specific 
detection block 44a being put at the center of the blocks is 
are latched by the latch circuit 64 in a step SI 21 
because the vertical signal Wand the horizontal signal 
HI* become the high level. The representative point 
data of 9 written in the representative point memory 66 
in a step S91 are latched by the latch circuit 68 in a step 20 
SI 25. Accordingly, in a step SI 29, the correlation calcu- 
lations are performed between the pixel data of 9 blocks 
from the latch circuit 64 and the representative point 
data of 9 blocks from the latch circuit 68, and therefore, 
the portion motion vectors in the third field can be eval- 25 
uated. Then,, the detection blocks 44 constituting the 
tracking area are determined in a step SI 35 on the 
basis of the reference vector memorized in a step SI 07. 
Therefore, in a step Si 36, the vertical signal VI ' and the 
horizontal signal HV and H2' are renewed according to 30 
an area surrounded by the detection blocks 44 adjacent 
to the tracking area at the outside of the tracking area by 
one block, and the vertical signal VO' and the horizontal 
signal HO' are renewed according to an area sur- 
rounded by the detection blocks 44 adjacent to the 35 
tracking area at the outside of the tracking area by two 
blocks. 

In and after the fourth field, it is determined whether 
or not the vertical signal VO* and VV and the horizontal 
signal HO' to H2' renewed in the step Si 36 become the 40 
high levels in steps S109, Si 1 1 . Si 1 7. Si 1 9 and S123. 
and then, the operation being the same as the operation 
in the third field is repeated. 

Since the above described tracking operation is 
performed in the second mode, in the third field, the rep- 45 
resentative point data of 25 as shown in Figure 15(a) 
are stored in the step S1 15 , and then, the pixel data in 
the detection blocks 44 of 9 are latched in the step 
S121 . and the representative point data of the last field 
read from the representative point memory 66 of the so 
detection blocks 44 of 9 are latched. Then, the portion 
motion vectors of 9 as shown in Figure 15(a) are evalu- 
ated on the basis of the pixel data and the representa- 
tive point data in the step Si 29. and therefore, it is 
determined that the area A as shown in Figure 15(a) is ss 
the tracking area in the step Si 35. Therefore, the verti- 
cal signal VI' and the horizontal signal HV and H2' are 
renewed according to the area B as shown in Figure 
15(a) in the step Si 36. and then, the vertical signal VO' 



and the horizontal signal HO* are renewed according to 
all the detection blocks 44 as shown in Figure 15(c). 

In the fourth field, at first, all the representative point 
data as shown in Figure 15(b) are stored in the step 
S115- Next, not only pixel data in the area B as shown 
in Figure 15(b) are latched in the step S121 . but also the 
representative point data of 23 in the area B as shown 
in Figure 15(a) out of the representative point data of 25 
written into the representative point memory 66 are 
latched. Then, the portion motion vectors of 23 are eval- 
uated on the basis of the pixel data and the representa- 
tive point data in the step S129. and thereafter, it is 
determined that the area A as shown in Figure 15(b) is 
the tracking area in the step S135, Accordingly, in the 
step Si 36. the vertical signal VO' and the horizontal sig- 
nal H1 ' and H2* are renewed according to the area B as 
shown in Figure 15(b). and the vertical signal VO* and 
the horizontal signal HO' are renewed according to all 
the detection blocks 44 as shown in Figure 15(c). Thus, 
by renewing the vertical signal VO' and VI 'and the hori- 
zontal signal HO' to H2' according to the movement of 
the object, and therefore, it is possible to determine only 
one tracking area including a specific object, and there- 
fore, it is possible to track the specific object. 

In addition, in the above described embodiments, 
the operation is performed at every one field, but it is 
possible to apply this invention even in the case where 
the operation, is performed at every one frame. 

Furthermore, in the above described embodiments, 
the area A is defined by the detection blocks adjacent to 
the tracking area by one block, but the extent of the area 
A should be determined by taking a movement speed of 
the object into consideration. Therefore, the area A may 
be defined by the detection blocks adjacent to the track- 
ing area by two or more blocks. Furthermore, in 
response to the extent of the area A. the extent of the 
area B should be changed. 

Although the present invention has been described 
and illustrated in detail, it is clearly understood that the 
same is by way of illustration and example only and is 
not to be taken by way of limitation, the spirit and scope 
of the present invention being limited only by the terms 
of the appended claims. 

Claims 

1 . A tracking area determination apparatus which 
determines an object tracking area within a screen, 
comprising: 

a first correlation means for evaluating a por- 
tion motion vector for each of a plurality of detection 
blocks formed in said screen on the basis of a min- 
imum correlation value between representative 
point data in a last field and pixel data in a present 
field of said plurality of detection blocks; 

a second correlation means for evaluating a 
correlation value between said portion motion vec- 
tor and a reference vector for each of said plurality 
of detection blocks; and 
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a determination means for determining 
detection blocks by which an object tracking area is 
to be defined on the basis of comparison of said 
correlation value and a predetermined threshold 
value. 

2 A tracking area determination apparatus according 
to claim 1, further comprising a reference vector 
detection means for evaluating said reference vec- 
tor for a next field on the basis of the portion motion 
vectors of said detection blocks constituting said 
tracking area. 

3 A tracking area determination apparatus according 
to claim 1. further comprising a first mode setting 
means for setting an operation mode into a first 
mode, wherein said portion motion vector is evalu- 
ated by said first correlation means with utilizing aH 
the detection blocks formed in said screen in said 
first mode. 

4 A tracking area determination apparatus according 
to claim 1 , further comprising a second mode set- 
ting means for setting an operation mode into a 
second mode, wherein said portion motion vector .s 
evaluated by said first correlation means with uti hz- 
ing detection blocks which are determined in the 
last field to constitute said tracking area and detec- 
tion blocks adjacent to said tracking area at an out- 
side thereof by at least one block in said second 
mode. 

5. An object tracking apparatus which tracks an object 
within a screen, comprising: 

a first correlation means for evaluating a por- 
tion motion vector for each of a plurality of detection 
blocks formed in said screen on the basis of a min- 
imum correlation value between representative 
point data in a last field and pixel data in a present 
field of said plurality of detection blocks; 

a second correlation means for evaluating a 
correlation value between said portion motion vec- 
tor and a reference vector for each of said plurality- 
of detection blocks; . . 

a determination means for determining 
detection blocks by which a tracking area is to be 
defined on the basis of comparison of said correla- 
tion value and a predetermined threshold value; 

a gravity detection means for evaluating a 
qravity of said tracking area; 

a motion vector generation means for gener- 
ating a motion vector on the basis of positions of 
said gravity and a center of said screen; and 

a tracking means for tracking said object 
according to said motion vector. 

6 A tracking area determination method for determin- 
ing an object tracking area within a screen, com- 
prising steps of; 
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(a) evaluating a portion motion vector for each 
of a plurality of detection blocks formed m said 
screen on the basis of a minimum correlation 
value between representative point data in a 
last field and pixel data in a present field of said 
plurality of detection blocks; 

(b) evaluating a correlation value for each of 
said plurality of detection blocks between said 
portion motion vector and a reference vector; 

?rrdetermining detection blocks by which a 
tracking area is to be defined on the basis of 
comparison of said correlation value and a pre- 
determined threshold value. 

A tracking area determination method according to 
claim 6. further comprising a step of (d) evaluating 
said reference vector for a next field on the basis of 
portion the motion vectors in said detection blocks 
constituting said tracking area. 

A tracking area determination method according to 
claim 6, wherein in said step (a), when an operation 
mode is set into a first mode, all the detection 
blocks formed in said screen are used as said plu- 
rality of detection blocks. 

9 A tracking area determination method according to 
■ claim 6, wherein in said step (a), when an operation 
mode is set into a second mode, detection blocks 
determined in the last field to constitute said track- 
ing area and detection blocks adjacent to said 
tracking area at an outside thereof by at least one 
block is used as said plurality of detection blocks. 

10. An object tracking method which tracks an object in 
a screen, comprising steps of: 

(a) evaluating a portion motion vector for each 
of plural of detection blocks formed in said 
screen on the basis of a minimum correlation 
value between representative point data in a 
last field and pixel data in a present field of a 
plurality of detection blocks; 

(b) evaluating a correlation value for each of 
said plurality of detection blocks between said 
portion motion vector and a reference vector; 

fcTdetermining detection blocks by which a 
tracking area is to be defined on the basis of 
comparison of said correlation value and a pre- 
determined threshold value. 

(d) evaluating a gravity of said tracking area; 

(e) generating a motion vector on the basis of 
positions said gravity and a center of said 
screen; and 

(f) tracking said objebt according to said motion 
vector. 
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